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SURVEILLANCE  PROBLEMS:  A  BREAKDOWN  MODEL 


Jagdish  K.  Patel 


Summary: 

An  economic  model  for  the  surveillance  of  a  production  process  Is  proposed 
and  studied  In  this  paper.  The  state  of  the  production  process  Is  described  by 
a  Poisson  stochastic  process,  denoted  by  x(t),  with  x=0  corresponding  to  the 
best  state.  The  production  process  Is  such  that  at  any  Instant  of  tis*  It  may 
go  to  the  next  state  or  may  break  down.  Breakdown  can  be  thought  of  as  a  state 
with  a  very  large  negative  Income.  When  x(t)  =  x,  the  Income  per  unit  of  time 
Is  l(x).  l(x)  is  assumed  to  be  a  nonincreasing  function  of  x  (x  £  0).  Repair 
Is  the  essential  part  of  the  model  which  is  decided  by  observing  the  production 
process  continuously.  It  Is  assumed  that  the  observation  can  be  made  without 
cost  and  that  the  result  Is  known  ImsMdlately.  The  cost  of  repair  depends  on 
now  the  orccass  ccmes  to  stop.  The  time  between  the  comeencement  of  operations 
following  repairs  and  the  recurrence  of  that  event  Is  defined  as  a  cycle. 

In  the  first  section,  the  model  and  the  assumptions  ar*  discussed  In  detail. 
In  section  some  general  results  are  given,  the  particular  cases  of  which  are 
needed  for  obtaining  the  expected  length  of  a  cycle  and  the  expected  Income  per 
cycle.  The  expression  fcr  the  lcng-run  average  Income  per  unit  of  time  is  given 
in  sectlcn  k.  In  section  3,  a  ’complete  class'  cf  strategies,  which  specify 
when  to  step  production  end  start  repair,  la  defined.  It  is  shown  in  section  U 
that  one  member  of  the  complete  class  is  optimal. 

Two  particular  cases  of  l(x)  are  considered  In  section  5  and  soma  numerical 
examples  which  illustrate  the  different  aspects  of  the  model  are  included  in 
section  6. 


Notation: 


1. 


3- 


4. 

5. 

6. 


x(t)  =  x  denotes  the  state  of  the  production  process,  where  t  is  the 

time  measured  from  the  beginning  of  a  cycle. 

i(x)  denotes  the  income  per  unit  of  time  when  x(t)  =  x. 

I(x,  T)  denotes  the  conditional  expected  income  from  production  in  the 
interval  (t,  t+T)  given  that  x(t)  =  x  and  the  production  is  allowed  to 
continue  to  t+T. 

A^  §  0,  parameter  of  the  Poisson  production  process. 

A^  §  0,  parameter  of  the  exponential  failure  (breakdown)  distribution. 


7a.  m^  denotes  the  number  of  time  units  required  to  make  x(0)  =  0  when  the 
production  is  stopped  at  x(t)  =  x  according  to  a  specified  strategy. 

7b.  k^  denotes  the  cost  per  unit  of  time  doing  this  work. 

7c.  m.  ,  k0,  corresponding  numbers  for  the  breakdown  situation. 

8.  t^  denotes  the  first  solution  of  x(t)  -  w+1. 

9.  t^  denotes  the  tlise  when  the  production  process  breaks  down. 

10.  Rv  denotes  the  strategy  which  specifies  when  to  stop  production  and  start 

repair. 

11.  1(RW)  denotes  the  long-run  average  income  per  unit  of  time  using  the 
strategy  R^. 


1 .  Introduction: 

In  an  earlier  paper.  Savage  [1962]  has  proposed  a  particular  model  for  a 
production  process  in  which  the  basic  characteristic  of  the  production  process 
is  that  it  tends  to  wear  out  unless  repairs  are  smde.  The  tises  for  making  re¬ 
pairs  are  determined  by  keeping  it  under  surveillance.  Two  forms  of  surveillance 
have  been  considered;  continuous  surveillance  without  cost,  and  costly 


surveillance.  The  production  process  is  assumed  to  be  a  Poisson  stochastic 
process,  thus  allowing  the  production  process  to  have  many  states. 

A  generalisation  of  Savage's  model  is  proposed  and  studied  in  this  paper. 

The  generalisation  is  in  the  direction  of  greater  complexity  of  the  model,  vis., 
it  allows  the  machine  to  break  down  independent  of  the  production  process  but 
preserves  all  other  characteristics  of  the  model.  There  are  situations  in  which 
the  production  process  may  at  any  time  either  go  to  the  next  state  or  breakdown. 
Breakdown  can  be  thought  of  as  a  state  with  a  very  large  negative  Income.  By 
Introducing  the  breakdown  feature,  the  field  of  application  is  increased.  The 
results  are  derived  only  for  the  case  of  continuous  surveillance  without  cost. 

To  be  specific,  consider  a  machine  which  produces  output  in  a  continuous 
stream  when  it  is  not  in  the  repair  state.  The  primary  Interest  is  in  the 
surveillance  of  a  machine.  The  problem  is  then  to  formulate  a  strategy  which 
specifies  when  to  stop  production  and  start  repairs.  The  basic  block  of  time 
is  a  cycle,  the  time  from  beginning  production  after  repair  until  the  recurrence 
of  that  event.  Let  the  state  of  the  production  process  while  producing  be 
denoted  by  x(t),  where  t  is  the  time  measured  from  the  beginning  of  a  cycle. 

When  x(t)  =  x,  let  the  Income  per  unit  of  time  be  l(x). 

In  this  paper,  several  assumptions  like  the  following  are  made: 

1.  x(t)  is  a  Poisson  process  with  parameter  A^  and  x(0)  -  0.  Some  of  the 

consequences  of  this  assumption  which  shall  be  needed  in  the  discussion  are: 

e_AlT(A  T)x 

(a) .  Prob(x(t  )-x(t  )  =  x)  =  — * - ■— 1 ,  where  x  £  0  and  T  =  t  -t0  i  0. 

id  x*  id 

(b) .  x(t)  as  a  function  of  t,  is  nondecreasing  and  with  probability  one, 

when  x(t)  has  a  point  of  Increase,  the  size  of  the  increase  is  one. 

(c) .  The  time  between  the  points  of  increase  of  x(t)  has  an  exponential 

distribution  with  parameter  A.  and  mean  ~  . 

X  4A- 
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(d).  The  x(t)  process  la  Markovian. 

(a).  Tha  x(t)  procaaa  haa  stationary  lndapandant  increamanta. 

2.  Tha  machlna  breaks  down  lndapandant  of  tha  production  procaaa  and  haa  an 
axponantlal  failure  dlatrlbutlon  with  parameter  . 

3.  Tha  x(t)  procaaa  can  ba  observed  without  coat  at  all  tlmaa  of  production 
and  tha  obaarvation  becomes  available  immediately. 

4.  Tha  magnitude  of  the  coat  of  repair  dapanda  on  whether  the  machlna  braaka 
down  or  atopa  according  to  a  apaeifiad  strategy.  In  tha  former  caaa,  tha 
coat  of  repair  can  ba  very  high. 

5.  The  income  function  l(x)  la  a  nonlncraaa lng  function  of  x,  tha  beat 
atata  la  atata  0. 

Not  all  the  raaulta  obtained  in  thia  paper  require  all  of  theae  aaauoptlona. 
Moat  of  tha  notations  used  are  In  accordance  with  tha  paper  by  Savage  [19^2] • 


2.  Preliminaries; 

To  proceed  with  tha  diacuaalon  in  detail,  one  needs  tha  following  definitions 
and  results: 

Let  1 (x ,  T)  denote  tha  conditional  expected  income  from  production  In  tha 
interval  (t,  t+T )  given  that  x(t)  =  x  and  production  la  allowed  to  continue 
to  t+T.  In  other  words 


(1) 


I(x,  T) 


t+T 


E[  / 

t 


i(x(a))ds|x(t) 


x]  . 


That  I(x,  T)  does  not  depend  on  t  follows  from  the  asau^tlon  that  x(t)  la 
a  Poisson  process. 

Let  m^  denote  the  number  of  tlma  units  required  to  — fc*  x(0)  =  0  when 
the  production  la  stopped  at  x(t)  =  x  according  to  a  specified  strategy  and 
that  k1  denotes  the  cost  per  unit  of  tlma  of  doing  this  work.  Let  a^  and 
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k2  be  the  corresponding  numbers  for  the  breakdown  situation,  (m^  S  m^,  kg  k^. 

In  the  following,  let  ^g(t)  denote  the  moment  generating  function  of  a 
random  variable  x  with  density  function  g. 


Theorem  1: 


Let  x  and  y  be  two  Independent  random  variables,  where  Prob(x  <  0) 
and  y  has  an  exponential  distribution  with  parameter  Ag,  then 

E  min(x,  y)  =  [l-tgC-Ag)], 


=  0 


(a) 


Proof: 


(2) 


(b)  Prob(x  <  y)  =  *  (-Ag) 


(a).  Let 


G  and  g  be  the  cumulative  distribution  function  and  density  function 
respectively  of  x 
and 

H  and  h  be  the  cumulative  distribution  function  and  density  function 
respectively  of  y. 

Let  s  =  mln(x,  y),  then 

F(*)  =  Prob[min(x,  y)  5  x]  =  l-Prob[min(x,  y)  >  s] 

=  1-[1-G(s)][l-H(s)]  . 


Now 


-v 


Es  =  /  sdF(s)  =  -/  sd{ [ l-G(s) ]  e  d  )  . 

0  0 

Integrating  by  parts. 


0°  -Ap* 

Es  =  /  [l-G(s)]  e  ^  ds  . 

0 
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I 

I 

I 

I 


Again  integrating  by  parts, 


(3) 


Es 


-  g(,)d*  ■  s;  tl-**('62)1  • 


oo  y  -Apy 

(b).  Prob(x  <  y)  =  /  [/  g(x)dx]d[l-e  ]  . 

0  0 


Integrating  by  parts. 


00 


oo  -Apy 

Prob(x  <  y)  =  /  e  g(y)dy  =  *  (-Ap) 


Corollary: 

In  theorem  1,  if  x  is  the  sum  of,  say,  n  independent  exponential-random 
variables  (i.e.,  has  a  gamma  distribution)  with  parameter  A^  then 


(5a) 


(5b) 


E  «in(x,  y)  -  [l-(  )"1 


pr.l>(»  <  y)  -  (  )”  • 


Proof: 

The  moment  generating  function  of  a  gamma-random  variable  with  parameter 
A^  evaluated  at  -A^  is  (5b). 


Definitions: 

Let  t^  be  the  time  of  the  i—  Jung)  of  a  Poisson  process  x(t)  with 

parameter  A.  Let  y  be  a  non-negative  random  variable  Independent  of  the 

Poisson  process.  Let  n  be  a  fixed  positive  integer.  Let  t  =  min(y,  t  ). 

n 

Let  r  be  the  state  of  the  process  just  before  t  so  that  tf  <  s  §  tf+^  . 
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Theorem  2: 


Given  r  and  z,  the  random  variables  have  the  distribution 

of  the  order  statistics  in  a  sample  of  size  r  from  a  uniform  distribution  in 
the  interval  (0,  z). 

Proof : 

The  proof  consists  of  two  parts. 

(a) .  Let  t  <  y ,  then 
n  3  * 

00 

f  £  (  f  ^ *  •  •  •  *  ^n-1  *  tn»  ^ 

Prob[t1,t2,...,tn_1|tn,  tn  <  y]  =  —  j 

/  f(t  ,  y)dy 
t 

n 

(since  y  is  independent  of  t's) 

*  ^ 

=  f(t1»t2»-***tn_lltn^  * 

Now  the  rest  is  the  proof  of  one  of  the  exercises  given  by  Parsen  [1963, 
p.  143].  Let  the  first  event  occur  in  (s^  8^+1^),  the  second  event 
in  (s  ,  sQ+h0)  the  (n-l)^  event  in  (s  s  ,+h  ,)  end  the 

n^  event  in  (tn,  tn+*ln)*  (T^ie  intervals  are  non-over lap ing. )  Then 


. *n-ljtn'hl'l2’”hn-l 


Prob[« j  s  tl  s  .^hj,  *  t2  S  Vh2 . Vl  S  S  -„.l*h„.1ltn] 


-Ah, 


-Ah 


(Ah,e  ^...Ah  ,e  n~^)  ^  e 
i-  n- 1  n 


-Ahn  -A(tn-hi-...-hn_i) 


k<Vhn» 

(n-l)I 


n-1 


-A(t  -h  )  -Ah 

_  n  n  . ,  r 

e  Ah  e 

n 
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hlh2  *  *  *hn-l 

(t  -h  )2  Ah 
'  n  n  n 

e 


Now  as  h  — >  0 
n 


(»-!)'■ 


(n-l) .h^hg . , *hn_^ 


<*.5 


n-l 


This  is  the  distribution  of  ordered  t's  in  a  sample  of  size  n-l  from  a 
uniform  distribution  in  the  interval  (0,  t^). 


(b).  Let  y  <  tf+1,  then 


Prob[t1,t2,...,tr|r,  y,  y  <  tf+1]  = 


(since  y  is  Independent  of  t's) 


/  *r+l* 


r+1 


!  f(e  !>  y)dt 

y 


^  f(tl,t:2 . V  tr+l^dtr+l 

f  f^tr+l^dtr+l 

y 

Lat  Sw-l^lc  be  substituted  for  tfc+1,  k=0, 1,2, . . . ,r  ;  tQ  =  0,  and 
since  t^jt^-t^, . . .  ,tr+j.-t  are  Independent  and  exponentially 
distributed  random  variables ,  then 


y_{  h(ti)h(t2-tl^  •  *  *h(tr+l”trWtr+rtr) 

Prob[ t^,tg, . . .  ,t^  |r,  y,  y  <  =  - — ~  ~  ■  ■■ 


y-t 


l  h^tr+l"tr^d^tr+l”tr^ 


l'(t1)h(t2-t1)...h(tr-tr_1), 

“A(y-tr) 


-A(y-tr) 
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(changing  tk+^-tk  ^k+lf  lc-0, 1,2, . . .  ,r-l  ;  -  0), 


^ » • • • * ^ 

“  tM  £(ti’e2 . t*|r'  y)- 

Now  Parzen  (1963.  p.  1^0]  haa  shown  that  given  x(T)  =  r,  where 
t^  S  tg  S...S  tr  S  T  (T  some  fixed  number),  then  t^,t2,...,tr  have  the 
distribution  of  the  order  statistics  in  a  sample  of  size  r  from  a  uniform 
distribution  in  the  interval  (0,  T). 

In  the  case  (b).,  y  is  a  random  variable,  but  for  each  value  of  y,  the 
above  theorem  of  Parzen  is  true,  hence  true  for  the  random  variable  y.  Combining 
case  (a),  and  (b).,  theorem  2  holds. 

Now  by  virtue  of  this  theorem,  the  density  function  of  ordered  t^  is 


(6) 


f"k> 


r! 

(k.l):(r.k): 


k-1 


[1- 


s 


]r‘ 


0  s  tk  S  , 
k=l ,2, . . . ,r  * 


Let  T. 

k 


z 


then 


f(Tk) 


r! 


(k-l)'(r-k)' 


_k-l / . 
Tk  (1< 


V 


r-k 


and 

(7) 


ET 


k 

k  =  r+T  * 


0  §  T.S  1 

k 


3.  Procedures; 

Consider  the  strategies  according  to  which  the  production  process  is 
to  be  placed  in  the  repair  state  at  the  first  instant  that  x(t)  =  w+1,  w  2  0. 
The  class  of  strategies  is  a  complete  class.  According  to  the  assuaptlon 

x(t)  is  a  Poisson  process  and  has  Markoff  properties.  Therefore,  the  decisions 
depend  only  on  the  present  state  and  not  on  the  past  history  of  the  process. 
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Also  note  that  the  future  history  of  the  process  does  not  depend  on  how  long 
the  process  has  spent  In  a  given  production  state.  So  if  It  is  ever  desirable 
to  place  the  process  in  repair  when  in  a  particular  state,  it  should  be  as  soon 
as  the  process  enters  that  state. 

Let  t  be  the  first  solution  of  x(t)  =  w+1.  Also,  let  t^  be  the  time 

when  the  machine  breaks  dawn.  Then  t  and  t,  are  random  variables,  t  has 

w  d  w 

a  gamma  distribution  with  parameter  A^  (see  assumption  l.b)  and  t^  has  an 
exponential  distribution  with  parameter  A^  (see  assumption  2).  One  can  also 
note  from  the  definition  of  a  cycle  that  the  length  of  a  cycle  is  also  a  random 
variable. 

Now  using  the  strategy  Rw> 

(a)  the  expected  length  of  a  cycle  is 

E  min(tw,  tfe)  +  n^Prob^  <  tfa)  +  n^Prob^  <  tw). 

(b)  the  expected  income  per  cycle  is 

El[0,  min(tw,  tfe)]  -  m^Prob^  <  tfa)  -  m^Prob^  <  tw). 

Then,  it  is  shown  by  Girshlck  and  Rubin  [1952]  that  with  probability  one, 
the  long-run  average  income  per  unit  of  time  denoted  as  l(Rw) 

.  EIt°-  mln<V  %>)  -  mikiProt,(t»  <  tb)  -  ^tgrrob(tb  < 

w  E  mln(  ty,  cb)  +  m^Prob(tw  <  efa)  +  m^Probf  <  t^) 

The  objective  is  to  maximise  the  long-run  average  income  per  unit  of  time. 

This  can  be  done  by  first  evaluating  i(R^)  and  then  finding  the  maximising 
value  w*  of  w. 

4 .  Computations : 

(a)  The  expected  length  of  a  cycle  is 
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E  ain(tw,  tfc)  +  *^Prob(tw  <  tfa)  +  n^Prob(tb  <  t^). 


Using  theorem  1,  this  expression  is 


(8)  —  [1-Dw+1]  +  DW+1(m1-m2)  +  , 

A, 


Wher*  °  =  (  A^  }‘ 


(b)  The  expected  income  per  cycle  (without  the  cost  of  repair)  is 

1*(tw,  tb) 

(9)  EI[0,  min(tw,  tb)]  =  E[  /  i(x(s))ds]. 


Expectation  is  over  both  min(tw>  tfe)  and  x(s).  This  expression  can 
also  be  written  aa 


(10)  Prob(tw  <  tb)  Efc  [  /  E{i(x(s))|tw,  t  <  t^)da]/t  <  t 

w  0 


Prob(tb  <  tw)  Et  (  /  E{i(x(s))|tb,  tb  <  tw)ds]/tb  <  tw  . 

b  0 


Now  consider  first 


t  t 

w  w 

/  E(i(x(s))|t  ,  t  <  t  )ds  =  e/  {i(x(s))|t  .  t  <  t  }ds 

0  wwo  Q  wwb 


tQ  t 

EC/  i(x(s) )ds  +  /  i(x(s))ds  +...+  /  i(x(s))ds)/t :  ,  t  <  t 

0  t_  t  .  wwb 

0  w-1 

=  E C tQi (0 )  +  (t1-tQ)i(l)  +...+  (tw-tw_1)i(w))/tw,  tw  <  . 

(using  theorem  2), 


t  £  -  t  A(w)  say. 

w  .  _  w+1  w  v  7 


h=0 
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the  first  term  of  (10)  is 


(11)  Prob(tw  <  tb)  Et  [twA(w)]/tw  <  tb 


oo 

=  /  [  /  t A(w)g(t  )dt ]  h(t  )dt 

0  0 


-±-  DW+2  Z  i(h)  . 
^1  h=0 


Now  consider. 


/  E(i(x(s))[t  ,  t  <  t  Ids  . 

0  DOW 


Let  the  machine  break  down  between  h  and  (h+l)^  state.  Then 
t^  <  t^  h+1  <  w+1.  For  convenience  let  T  =  t^,  then  x(T)  =  h. 

Write  the  above  expression  as 


(12) 


{  Eh/T  E3.(.)/K,Tt1<»(*)>lk*  h+1  • 


Using  theorem  2,  one  gets  as  before 


T  h 

E„(.)/h,T  !0  U(*(.))|h. 

Then,  (12)  cau  be  expressed  in  the  following  form: 


T  L 
h=0 


AT  h 

.  .  (AjT)  h  ^ 


h: 


-A.T 


±1 


h+1 


w  e 

£  — 
h=0 


1  (AjT)1 
"hi 


TA'(T,  w)  say. 


After  replacing  T  by  t.  ,  the  second  term  of  (10)  is 


(13)  Prob(tb  <  tw)  Et  [tbA'(T,  w)]/tb  <  tw  =  /  /  tbA'(T,  w)h(tb)g(tw )dtbdt^ 

b  0  tb 
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Integrating  ovar 


t  first  and  using  tha  raault  that 
v 


I  8(0dt 

s 


AS,  vh 
w  a  (A^t.) 

-  ,  va  can  now  write  aquation  (I3) 


L 

h=0 


hi 


(14)  Prob(t.  <  t )  E  [t  A'(T,  w)]/t  <  t  =  E  E  i(j)Dh+2  . 

b  w  Cb  °  °  W  h=0  J=0 


The  right  hand  side  of  (14)  can  also  be  written  as 


w  w 


Ap  -  "  v.o 

— -  L  L  l(j)D  ,  which  reduces  to 
A!  J=0  h=J 


(15) 


-  L  l(h)Dh41  -  -J-  DW+2  L  1(h) 


n  h=o 


h=0 


Combining  (11)  and  (l4)  In  (9)»  (9)  becomes 


EI[0,  min ( t  ,  t  )]  -  --  E  l(h)Dh+1  . 

A1  h=0 


Hence , 

(c)  The  long-run  average  Income  per  unit  of  time  Is 


(16) 


i(r)  = 


r,  =  1(h)Dh+1  +  ""^VlV  - 


J1  h=0 


~  [1-DW+1]  +  DW+1(m1-ii^)  + 


To  vise  l(Rw)  correctly,  one  has  to  notice  that  w  Is  a  non-negative 
Integer;  A^,  A^  are  dimensionally  (time)”*;  i(x),  k^,  kQ  are  dimensionally 

(money/tlma)  and  m^,  m^  are  dimensionally  (time). 

The  next  problem  is  to  find  an  optimizing  value  w*.  However,  (16)  Is  very 
involved  in  w.  Hence,  it  will  not  be  easy  to  obtain  a  convenient  expression  for 
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v*.  But  It  is  important  to  investigate  whether  there  exiata  a  unique  w*  or 
not.  The  following  theorem  doe8  that. 


Theorem  3: 

A  aufflcient  conditon  for  l(Rw)  to  be  unimodal  ia  that  l(h+l)  -  i(h)  <  0, 
h  g  0. 


Proof: 


K».) 


E  i(h)Dh+1  +  DW+1A1A2(mr,k2-m1k1)  -  m^k^Ag 

h=0 

u  1  1 

A^l+avyX*)  +  D  A1[(m1-m2)A2-l] 


Let 


P  =  ^(“skp-Vi) 

T  =  A^ltm^) 


M  "  » 

S  ;  A1[(m1-n^,)z^-l]  . 


Cone ider 


A„ 


I(R.+l)-t(Rv) 


W+l 

E 

h=0 


i(h/D 


h+1 


V+2 

D  P- 


M 


w 

E 

h-0 


i(h)D 


h+1 


+  D 


w+ 


V-M 


_  _W+2.’ 

T+D  S 


_  „w+l„ 
T+D  S 


=  [(T+DW+1S)(T+DW+2S)]*'1  f(w)  eay  . 

Since  the  term  inaide  the  square  bracket  ia  positive,  the  aign  of  1 (RW+1)-I(RW) 
depends  on  f(w),  where 

f(w)  =  TA  [  2  i(h'/Dh+1  -  E  i(h)Dh+1]  -  TPDWfl(l-D) 

h=0  h=0 


DW+1A.S[ 


w+l 

E 

h=0 


i(h)D 


h+1 


-  D 


w 

E 

h=0 


i(h)Dh+1]  - 


mdw+1s(i-d) 


TAnDW+2i(w+l) 


T?DW+?  ~  +  DW+1A  S[DW+2 

Aj^  2 


i(w+l)  +  (1-D)  E 
h=0 


i(h)Dh+1] 


f(v)  =  AoDW+21(w+1)[T+DW+1S]  +  Dw+3  ^  S  £  l(h)Dh  -  DW+2  ~  [TP+MS]  . 

d  h=0  1 

Mow 

.  w+1  w  , 

T+DW+1S  =  (T+S)-S(1-DW+1)  =  (T+S)-S(  1~— -r  ) ( 1-D)  =  (T+S)-S(l-D)  £  Dh 

V1"0'  h=0 

Aj?  W 

f(w)  =  DW+2AJ(T+S)l(w+l)  -  (TP+MS)]  -  DW+3  ^  S  £  Dh[  l(w+l)-i(h)  ]  . 

^  A1  al  h=0 

Now  putting  back  the  values  of  P,  M,  S,  T  in  the  first  term, 

f(w)  =  DW+2a1A1A|[l(w+l)+k1-m2A2(k2-k1)]  -  DW+3  —  S  £  Dh[l(w+l)-i(h)  ]  . 

1  h=0 

Now  If  i(h+l)-l(h)  <  0  ,  hi  0,  Chan  the  sacond  term  on  Cha  right  la  always 
nagativa  (S  <  0).  Ona  can  also  notica  that  as  w  lncraaaes  tha  first  tarn  on 
tha  right  dacraasas.  Hanca  f(w)  Is  a  dacraaslng  function  of  w.  This  Implies 
that  thera  la  at  most  ona  changa  of  sign  as  w  Increases,  l.a.,  thara  exists 
a  unique  w*  S  0  which  maximises  l(Ry). 

Some  of  the  qualitative  properties  of  l(Rw)  are  Lite  following: 

(a).  Whan  A^  =  0,  the  model  reduces  to  that  of  Savage  [1962]. 

Definition:  A  random  process  x  dominates  tha  random  process  x',  If 

and  only  If  thara  exists  a  function  g(x)  defined  on  tha  range  of  x  such 
that  g(x)  has  tha  same  distribution  as  x1. 

Lemma;  In  any  decision  problem,  If  x  dominates  x1,  than  any  strategy 
based  on  x'  whan  x*  Is  being  observed  can  also  be  used  when  x  Is  observed. 

Lemma:  In  the  breakdown  model,  If  one  considers  A^  <  A^,  than  tha 

observed  process  with  A^  Is  dominated  by  the  observed  process  with  A^. 
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(b).  Theorem  ki 


The  maximum  long-run  average  income  per  unit  of  time  la  a  decreasing 
function  of  Ag. 

Proof: 

Conaider  two  modela  which  differ  only  in  the  value  of  the  breakdown 
parameter.  For  the  firat  model  aaeurna  this  parameter  has  the  value  Ag  and 
for  the  aecond  model  A^.  We  assume  0  <  Ag  <  Ag.  It  will  be  shown  that  the 
maximum  income  from  the  Ag  model  is  greater  than  the  maximum  income  from  the 
A^  model . 

By  introducing  randomisation  one  can  generate  a  new  stochastic  process, 
denoted  by  x*,  associated  with  the  Ag-process  such  that 

(I)  x*  has  the  same  distribution  as  the  A^ -process  (ao  <  Ag) 

(II)  the  occurence  of  the  events  in  the  x*-process  will  not  be  later  than 
the  events  in  the  Ag-process. 

Hence,  if  repairs  are  made  according  to  the  optimal  strategy  associated  with  the 
A^ -process  when  in  fact  observing  the  x*-process ,  the  distribution  of  the 
lengths  of  cycles  will  be  exactly  the  same.  The  income  from  production  during 
the  cycles  will  also  be  exactly  the  same.  But  the  costs  of  repairs  with 
x*-process  will  be  less  than  those  associated  with  the  Zv' -process .  This  is 
because  the  costly  repairs  will  always  be  made  if  the  A^-process  stops  but  the 
costly  repairs  will  net  be  made  all  of  the  time  when  the  x*-procsss  stops. 

Thus  using  the  strategy  on  x*  or  equivalently  on  Ag-process  the  income  from 
Ag -process  can  be  made  to  exceed  the  average  income  per  unit  of  tine  from  the 
Ag-process. 

Finally,  the  x*-process  can  be  constructed  as  follows:  Let  t,  be  the 

D 

random  variable  of  breakdown  times  for  the  Ag-process.  la.  t*  be  an  exponential 
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random  varlabla,  ganaratad  by  ualng  a  table  of  random  numbers,  with  parameter 
equal  to  Then  it  ia  clear  that  x*  =  min(t^,  t*)  has  the  desired 

properties  (i)  and  (ii). 

(c) .  Conjecture: 

v*  is  an  increasing  function  of  A^ • 

In  the  following,  two  particular  cases  of  i(x)  are  considered. 


5.  Particular  cases: 


(a).  Consider  l(x)  =  A,  x  >  0,  A  >  0. 


Though  this  case  is  not  important  from  the  point  of  view  of  its  practical 
usefulness,  still  it  is  considered  here  as  an  example. 

l(R  )  can  be  obtained  either  from  (l6)  or  directly  using  (8)  as 


(17) 


K»w)  = 


^  (1-DW+1)  +  DW+1(s^k2-m1k1)  -  s^k2 

1  /.  _w+l*  „w+l,  v 

—  (1-D  )  +  D  +  *g 


Notice  that  w*  =  +»  (i.e.,  continue  the  machine  until  it  breaks  down)  is  the 

optimising  value,  and 


(18) 


I(R  )  -  A-"^ 

I(RW*}  -  1+^Ag  * 


(b).  Consider  l(x)  =  A-Bx,  x  £  0,  B  >  0,  AS  0. 
From  (16), 


(19) 


I(R„) 


w+1  A.  A. 

D  [B(w+1)+B  -i  -A+A^s^-m^l-hA-B  £  -^k^ 


(1+m2A2)-DW+1[l.+A2(%:-mi)] 
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To  see  that  for  Ag  =  0,  this  expression  reduces  to  that  of  Sevege  [1962], 
divide  both  numerator  and  denominator  by  A^  and  then  combine  the  terms. 

Since  i(k+l)-i(k)  <  0,  theorem  3  says  that  there  exists  a  unique  w* 
which  maximises  (19) .  To  work  with  the  critical  equation  associated  with  (19), 
the  computations  will  be  made  as  if  w  is  a  continuous  variable.  Then  setting 
the  derivative  of  (19)  with  respect  to  w  equal  to  sero,  one  obtains 

(20)  B[ l+A^n^ -m1)]DW+1-wB(l+m2A2)log  D-BU+m^) 

-  [B+B(m2A2+m1A1)-m1A2(A+k1)+m1m2^(k2-k1)]log  D  =  0  . 

Let  w*  be  the  root  of  (20),  then  it  can  be  shown  that  one  of  the  Integers 
adjacent  to  w*  is  the  optimising  value.  To  get  l(R ),  i.e.,  the  maximum 

IT* 

long-run  average  income  per  unit  of  time,  one  can  use  either  (19)  to  get  an 
exact  value,  or  the  following. 

Let 


(21)  I(R.>  *  5$  • 

then  it  is  easy  to  see  that 

<22>  ^  -  | ’ 

where  prime  denotes  the  derivative  with  respect  to  w  evaluated  at  w*. 


(23) 


A1 

B+[B(w*+l)+B  —  -A+A2(^k2-m1k1)]log  D 


-[l4A2(m2-m1)]log  D 

In  working  with  (23),  the  root  of  (20 )  sh*  >  <i  be  used  to  get  a  close  approx isat ion. 


6.  Examples: 

Consider  i(x)  =  A-Bx  ,  x  §  0,  B  >  0,  A  2  0. 


-18- 


l(Rw)  1*  given  by  (19)  and  tha  critical  equation  aaaociated  with  it  la  glvan 
by  (20).  Notice  that  while  aolving  (20)  for  wv  one  geta  a  fractional  valued 
w*.  Aa  remarked  earlier,  the  correct  value  of  w*  ia  one  of  the  adjacent 
lntegera.  The  following  table  indlcatea  the  effect  of  change  in  the  valuea 
of  the  parametere  on  w*  and  l(Rw#). 


Example 

A 

B 

"l 

"2 

kl 

k2 

h. 

*2 

w* 

I(R„.) 

1 

10 

1 

2 

2 

2 

2 

1 

1 

8 

1.66 

2 

10 

1 

2 

4 

2 

O 

1 

1 

5 

0.2 

3 

10 

1 

2 

O 

2 

4 

1 

1 

5 

0.34 

4 

10 

1 

O 

2 

2 

4 

9 

1 

6 

-0.88 

5 

10 

1 

2 

2 

2 

2 

9 

1 

9 

0.053 

6 

10 

1 

2 

0 

2 

0 

1 

0 

4 

5.5 

7 

10 

1 

2 

2 

2 

2 

1 

9 

10 

-1.37 

8 

0 

1 

2 

2 

2 

2 

1 

1 

1 

-1.55 

Examples  2  and  3  illustrate  the  effect  of  increase  in  the  coat  of  repair 
after  breakdown.  Also  notice  examples  4  and  5.  Comparing  examples  1,  6  and  7> 
one  can  see  that  it  illustrates  theorsm  4,  vis.,  I(R  )  is  a  nonincreasing 
function  of  and  the  conjecture  that  w*  is  a  nondecreasing  function  of  A 
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